According to Governing Body member Geoffery Jackson in his testimony to the Royal Australian Commission, if a person leaves on his or her own accord and becomes inactive, they have disassociated themselves and the congregation doesn't pursue the matter unless they try to come back.
This video covers the official stance on that matter, starting at the 1:00 mark at the beginning of the video.
I wouldn't go to the hearing. Perhaps you can send the video to the elder who is talking to you and point out the part he needs to listen to and let him know that's why you won't be attending the meeting.
Later if they still pursue the matter with you, you could let them know that if there is any sort of announcement made about you or if they try to influence your family against associating with you, you'll be looking into what legal avenues are available for you to pursue.